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ABSTRACT > , 

/>,In 1981, a scale, the Emergent Reading Ability 
Judgments for Dictated and Handwritten Stories^was developed for use 
in assessing hefw close a child was to reading^independently based 
upon the nature of the child' s. attempts to read from dictated and 
handwritten Stories. \A study w^as conducted to apply the scale to 
stories from a new sample of Children whose overall emergent reading 
abilities were ascertained by pother techniques. The question, 
addressed was whether the scale covers the reading attempts of these 
children. Subjects&for the study were nine Kindergarten children who 
fell into hig)%4 moderate, or low emergen^*, reading ability groupings. 
The* children's own dictated and handwritten stories comprised the 
materials used for reading attempts. Findings showed that the scale 
could be applied to repeated reading attempts .of kindergarten 
children. Further analysts indicated that . the scale discriminated •• 
between 'groups of children who- differed^ in . overall emergent 
abilities. There was also a trend in the data for -children to improve 
across time. In addition, the scale showed moderate and, in two of 
three instances, significant ability to rank subjects similarly 
across dictated and handwritten -forms "within a givj|n trial. Finally, 
even thougfithe two measures were devised upon different bases for 
different purposes, the scale and a traditional- readiness test also 
tended to rank children similarly. (HOD) 
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The purpose of this paper is to describe the development &nd 
validation' of an assessment tool for judging the emergent reading abil- 
ities of young children^. In particular, this tool is designed for£use 
with children's reading at temporising their own stories, both hand- 
written and dictated, as the texts. (The term "story" is tjjsed here to 
indicate the composed text, regardless of any genre classification, b£- 

c 

cause, the Term "story" was used with the children.) 
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The term "emergent, reading ability, 11 as described by Holdaway 

(1979), emphasizes the importance of early reading-like behavior as 

S 

being true literacy skills, not merely indicators ^>f reading readiness 
in the traditional sense of predicting achievement in a yet-to-be-ac- 
quired skill. Emergent reading abilities can be considered to be 
readiness in ttfie sense, however, of providing readiness for the next 

\. * > 

step jj^ on-going acquisition. 

Researchers who choose to investigate the transition period 
from pre-reading or emergent reading to independent reading are faced 
with some unique problems, including bow to describe the nature of 

c » * ■ ' 

* 1 f 

reading materials for 'beginners. The position Being taken in this 

study is that any 'tool for judging emergent reading attempts must be 

• A " 

based upon an analysis of the fit between the. text being "read" and 
the knowledge of the young "reader" about that text. Thus, a tool that 
fits the child f s attempts to read his/her own dictated and handwritten 
texts will have characteristics specific to those kinds of texts. It 
may be similar to tools used for emergent reading of other text types 
like storybooks (Haussler, 1981; SulzBy* 1981b). or basal readers (Clay, 
1978) but it will be constrained by the intimate relation between 
reader and his/her own text. * * 

Various analyses have been' made between text types and early 
reading. Sulzby (1981b) contends tohat both handwritten and dictated 
stories support 'emergent comprehension's exhibited in memory for text 
but do not tend to 'support comprehension as construction of intended / 
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meaning. Dictated stories tend to support memory for conventionally- 
spelled units while handwritten stories tend to give more support to 
yise of letterrsound information but not necessarily in conventional 
spelling form. Holdaway (1979) argues that the child's own composi- 
tions consist of less memorable language than do favorite storybooks^ 
thus storybooks suppoct irtemory for text more than do child compositions, 
in his view. Neither researcher has yet published a comparative study 
between the text *fcypes nor does this study propose to make such a com- 
parison. Instead, it addresses th| question of whether a scale for the 
child 's dictated and handwritten compositions can produce reliable and 

t r 

valid estimates of emergent reading for those texts. 

Dictated 'Stories haveibeen described as important first texts 

for young readers. Most of the arguments supporting-these texts have 

q * - 

consisted oS illustrative examples and/br rationales". Stauffer' (1970)- 

' • ' f 

suggested that using children's otal^iS)iguage "wrj^tfen down" in dicta-* 
tion is an appropriate technique for inducting a child into independent 
reading. The advantage of this approach involves the fit "between the 1 
text and the knowledge of the young, reader; difficulty level is con- ! 
.trolled because the syntactic pjatterns, topics, and vocabulary choice 
come from the child him/herself. 



r 



• Support for "the use of the child s. own written compositions is 
somewhat indirect. x Primarily*, it comes from descriptive studies that 
indicate that, while reading and writing may not be considered • to be 
mirror-images (Bissex, 1980), they do develop within the satoe time frame 
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and appear to be ipportantly/related (Gentry & Henderson, 1978; Read, 
1971). Chpmsky (1971) proposes that the child should be encouraged to' 
"write first, read later" because the child can , learn much about 
reading from writing. Graves (1979) and Sulzby (1981b) indicate that 
the child engages £n much re-reading as a voluntary pfirt'of composition. 
Such composition includes but isNagt restricted to the use of invented 
'spelling (Clay, i978; Sulzby, 1,981b). 

Sulzby (1981c) reported the development of a scale for use in 
assessing how close a child is to reading independently based upon the 
nature of the child's attempts to read from dictated and handwritten 
stories. In dictation, a scribe' writes the words which 'a child says in 
response to a "dictate 11 request. In handwritten composition, .the child 
uses whatever writing system s/he prefers. The Scale was developed 

* <» ^ , I v 

from both the nature of the composition and the re-reading attempt.- 
, Sulzby applied v the scale to pairs of dictateS^and handwritten 
story-reading attempts *of 24 kindergarten children; the study included' 
a complete replication .of story sets, leading to 96 judgments, 48 each'' 
for dictated and handwritten stories. Agreement between judges was 
high (96%) and the rank order correlation between the .two replications 
each containing 48 attempts was rho = .77 (corrected t for ties), p<.01. 
She reported a rank order correlation between average scores for four 
applications of the scale .and the " Metropolitan Readiness Tests, Form P , 
Level 1» of rho = .37 (corrected for ties), p^.05. She interpreted * 
these scores to .indicate that the scale did have acceptable reliability 
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»in scoring, consistency across time with thfe same children, and some 
relationship with scores derived ftom traditional measures for pre-^ 
dieting reading achievement (readiness tests) • 

The Sulzby (1981c) study was limited in scope to the consis- 
tent of the scale and to the relationship between the scale an<J a 
traditional readiness test. There was no convincing assessment of the 
scale as a valid measure of emergent reading abilities of pny kind be- 
sides the reading of dictated and handwritten stories. Additionally, 
the -scale was applied to the data from which it w^s derived so ques- 
tions remain about whether tliire might be significant categories of 
behavior that were either not exhibited or not detected in the original 
sample. 

. , These limitations and -fehe need to further explore the emergent 

o * _ - ■ • 

reading abilities of kindergarten children led to the current study. 
This study was designed to address more specific issues of the relia- 
bility and validity of the Emergent Reading Ability Judgments for Dic- 
tated and Handwritten Stories (Sulzby, 1981c). The current study ap- 
plies the scale to stories from a new sample of children whose overall 
emergent reading abilities were ascertained by other techniques. 

This study add£esses v the question of whether the scale coyers , 
the reading attempts of these children. If it ^covers the behaviors 
• (p validity issue), can trained judges apply the scale with sufficient 
agreement and how reliable are repeated administrations of the scale 
toVeading attempts of the same children across trials? 
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In addition to the ability of the'scale to cover the' new data, 
4 7 

.other validity issues include the following concerns. How well does it 

, discriminate subject groups chosen on overall emergent reading ability? 

flow well does it discriminate subject groups' achievement "across time?' 

flow well does it describe behavioral change across time? Finally, how 
* - , *" 

does, it compare with a test of reading readiness? ' 

Method ■. 

Subjects 

Nine children were, selected for case studies from among 24 chil- 
dren in a kindergarten classroom in an upper middleclass suburb north 
of Chicago, Illinois. The children were identified as being either 
high, moderate, or low in overall emergent reading ability at the be- - 
ginning of the kindergarten year of 1980 T 8l'. ^his identification was 
based upon results of an interview study, "General Knowledges About 
Written Language," with. teacher judgments used to refine the researchers' 
selections. Full procedures may Be found in Sulzby (1981a). 

The case study sample consisted of five girls and four boys, 
« • 
ranging in age ffo& 4-11 to 5-11 in October. Three children fell into 

each group, with sex distribution not equal within groups. The high 
group consisted of three girls; middle group, of two girls and- one boy; 
and the low group, of two boys ana one girl. This distribution was re- 
flective of the distribution of overall emergent reading ability within 
the 24~ch£ld4 classroom. 



* * 
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The children's .own compositions comprised the materials used for ^ 

reading attempts. Dictated and handwritten story pairs were collected 

1 during the course of two different studies. Study II, "Real and Make- 

j Believe Topic," contributed two complete sets, stories about learning 

to ride a big wheel. Study IV, "New Event Stimulus," yielded* one set of 

stories about a race with /novelty wiijid-up toys that triads of "children 

participated in just prior to composition and re-reading. For purposes 

of this paper, those three story sets will be referred to as Trial 1, 

Trial 2, and Trial 3. Trial 1 took place in January and early February; 

* 

Trial 2 took place in February; and Trial 3, in April and May, 

I % 

Scoring . / 

Two trained examiners scored the full collection of story/reading 
attempts. Initial scoring was done independently, using Y the Sulzby (1981c) 
"sc^le with conferences over disagreements. There were 54^ story/reading 
pairs, with 27 dictated and 27 handwritten attempts. Judges were able 

to come to complete^ agreement bu£ it should, be noted that the agreement 

• *, 
was conferred rather than independent for reasonfe that follow.* 
. . - . jy • 

Initial, scoring ^yielded 12 cases that did not fit the scale. 
These cases were of three kinds: one time the child produced what may be 
called a^'pattern" story rather than the story requested; two times an 
examiner had given an illegitimate prompt^ during the re-reading attempts; 
and nine times, the child's behavior did not fit the scale as originally 
'worded.. This final group consisted of one kind of* behavior that was 
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judged to be the equivalent of Sulzby' s "five" category. The initial 
"five" category was defined as an instance in which the child f s eyes 
were not on print but his/her story rendition was stable; the in- 
stances in which the sc$le) did not fit were all times when the child's, 
eyes were on print (not tracking) but his/her story was not- stable.* 
These behaviors were clearly more advapced than "four," and not so ad^ 

r* 

i 

vanced as "six" in which the child is able to maintain eyes on print 

and a stable story, without actually reading the print independently • 

/* . 

Table 1 gives the scale with this revision' and with wording modifica- 
tions for clarity. 



Insert Table 1 about here or at end 
(Editor's preference) . * 



After the scale was revised the scorers were easily able to 
classify 89% of the attempts, with the exception of the other three 
mentioned above* These three cases were discussed until* the examiners 
agreed upon a placement for the attempts based upon inferences jtrom 
surrounding evidence such as storytelling attempts, samples of aspects 

4 

of reading, and other comments- from the full protocols. One of these 

j 

judgments resulted in a data point that seem%d to be outside thfc gen- 
eraJL developmental pattern but £he placement seemed to be consistent 
with the child's performance within the bounds of the scale; this was 



the '.'pattern" story in which the child dictated series of "I like 



my 



1 



10 
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mou^ I like my dad; I like my cat," sentences rather than the big 
wheel story, J 

x 

Analysis • , 

To examine tfre ability of the scale .to distinguish between 
groups of children judged to be of differing ability, a 3 (Groups: 
high, moderate, low) X 2 (Mode: dictated, handwritten) if 3 (Trials: 1, 
2, 3) mixed analysis of variance was conducted with modes and trials* 

V 

as repeated factors. Rank order correlations were calculated ffcr each - 
dictated/handwritten trial and for comparing the set of judgments with* 
results of the Metropolitan Readiness Test, Level I, Form P (11/4/80). 

Results ' • 

Results of the analysis of variance are shown in Table 2. These 

findings indicate that ther scalB differentiated between groups signif- 

7 

icantly, F(2,6)=9.03, j><.025. The means for the groups were as fol- 

lows: HigTi, 6.2; Middle, 4.4; and Low, 3.3. Two of the three children 

t 

in the high group were at ceiling levels (total scores for six obser- 
vations were 42 and 4l*or 42), thus the differences between groups can 
be considered to be Conservative. 



Insert Table 2 sbout here 



In addition to group differences, the only. other significant re- 
sult of the analysis of variance was the interaction between -Mode and 



ii 
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Trials, F(4,32)=5.31, p<,01. Figure 1 shows that interaction graphed; 

dictated story reading attempts tended to be scored slightly higher 

than handwritten stories for the final, two trials, but for Trial 1-they 

t 

were quite a bit higher (mean of 5.2 compared with 3.4). 



Insert Figure 1 about here 



Another question about group differences can be addressed by—* 5 ** 
examination of the means for the nonsignificant Groups by Trials inter- 
action. The question is *-two- fold: (1) were groups distinguished ^ 
across time, and (2) did children increase in Emergent Reading Abil- 
;JT&ties for Dictated and Handwritten Stories pver time? While the main " 
effect for groups answered the first part of the questional the affir- 
mative, the means displayed in Table 3 show that, while ttye high group 
was almost at ceiling and stayed stable over time, the low and middle 
group mean scores increased across trials. 



Insert Table 3 about here 



The rank order correlations (corrected for ties) between the~ 
pair* of dictated and handwritten^ tories were as follows: Trial 1, 
rho=.83, (£<.01); Trial 2, rho=.58 (NS); and Trial 3, rho=.73 (£<.05). 
The correlation between the total scores for the ERAJ for the six ses- 



12 
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sions and the total raw scores on the Metropolitan Readine$s 

Test, Level l,^was rho=.80 (p{.05/ uncorrected since there was only 

one tie). — ^ ^ 

• 1 

\ These correlations indicate that the rank order of subjects be- 
tween the paired administrations^ of the scale tended to be maintained. 
Additionally, the rank associated with" the subjects' tqtal scores for 
the six sessions tended to be close to the rank of subjects 1 scores 
from the Metropolitan. . 

Discussion < 

The scale, Emergent Reading Ability Judgments for Dictated and 
Handwritten Stories, was able to be applied to repeated reading at- 
tempts of kindergarten children* This application required one revi- 



sion in order to capture^ behavior not covered by a previous version of 

- ; / 

the scale. ^Revision of the scale resulted In an assessment tool which 
could bemused by trained examiners with high agreement\ 

The scale is limited to children's reading attempts using their 
own compositions, 'dictated and handwritten, as the texts. A further 
limitation of the scale is that people using it must* be knowledgeable 
about the nature of young children's yti!ting systems. The scale re- . 
quires the* 'assessment both of the composition and of the re-reading 
attempt. It is thus a orie-to-one assessment tool. Finally, the scale 
only makes gross discriminations of ordinal level. It does not give 
finer diagnosis of the child's attempts -as theTcTf^ld nears independent 

reading. Thus it may imply a more. rigid sequence than a closer exW- 

,/ 

ination of exact reading-like behaviors reveal* 

13 
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> 

Nevertheless, the analysis of variance over three repeated ad- 
ministrations of the scale to dictated and handwritten story reading 
attempts indicated that the scale discriminated between groups of 
children who differ in overall emergent rea^inlg abilities. While the 
main effect for trials was not significant, there was also si trend in 
the data for children to improve across'* time, particularly for hand- 
written stories. 

In addition to the ability of the scale to discriminate groups 
of children the scale also showed moderate and, in two of three in- 
stances, significan^ability to rank subjects similarly across die- « 
tated and handwritten forms within a given trial. This correlation 
is worth no'ting, given th6 mode by trial interaction (see Figure it).. 

While the dicta ted^mean for Trial 1 was significantly higher tfhan the 
handwritten mean, the ranks of scores for those two administrations 
were significantly related. ^ 

Finally, even though the two measures are devised upon differ- 
ent bases for different purposes, the scale and a traditional readines 

\ 

test also tended to rank children similarly. The correlation for\this 
comparison was the children's total ERAJ scores across four to' five 
months and the total raw score for the re^iness test. It W9uld be 
surprising and somewhat suspicious if the two measure? were totally 
unrel^$f£d since both purport to measure some facets associated with 
written 1 language. 



14 
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It should be remembered that the correlations reported are for 
ranks and are for nine children. Hence, the significance level is more 
•important than the magnitude/ Sulzby (1981c) reported significant rank 

0 

order correlations for a different and larger sample (N=24) . . 

The Emergent Reading Ability Judgments for Dictated and Hand- 
written Stories has two potential uses. It can be used, along with 
other tools, in research in early- literacy development. It can also 
be used by teachers of young children to provide one measure of on- 
going emergent reading and writing abilities. In both kinds of use; 
it is lijnited to being a gross measure of structural characteristics. 
It needs further refinement and should be used in combination with 
other assessment tools; nevertheless, it seems to provide some assur- 
ance of being one reliable and valid assessment tool for reading behav- 
iors of young children who are not yet reading independently. 
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%able 1 

Emergent Reading Ability Judgments 

for Dictated and Handwritten Stories, Revised 
* 

Score ' 4 . 

assigned Behaviors observed 

(For 1-2, .any production cannot be called a story or composition eith^ 
by intention or by characteristics of £ne product.) 

1 No dictated nor handwritten stories; hence, no attempt to 
re-read. Child refuses to pretend-write. 

2 In response to request to handwrite a stox^r, no "story" 

is produced but there is some primitive evidenqe of reading 
and writing. In response to request to dictate .a story, 
child says something that does not se^m to be treated as 
a* composed unit; it may consist of conversational 
characteristics either in wording or in turn-taking. 
It is -either nqt re-read or re-reading attempt is 
very primitive. 

(For 3-7, stories or their equivalent are produced.) 

3 While stories are produced, child refuses to re-read. 

I For own writing, child 'may say that the story "doesn't r 

say . anything," or,, for dictation, "I can't read." 

4 Child attempts to re-read but eyes are not on print. 
Story recited is similar to original but not stable. 

5 This seems to be a period during which* the child cannot^ 
sinful taneou sly maintain eyes on print and recite stable 1 . 
story. Score "5" either if (a) child's eyes ar£ on 
pript but story refcited is similar but notstable* or 

(2) child's eyes are not on print but story recited 
.is stable.* 

6 Eyes are on print but child is not tracking print. Story 
recited is stable.* For handwritten story, print may 
still be pretend-cursive or other writing system if the 
story accompanied the composition, either as shown by 
voicing during composition err by other evidence such 

as mixture of invention or reference to units by intention. 

7 Child's eyes are tracking print, matching voice to print, 
"actually reading," independently, with attention to 

, meaning. To be rated as a "7" story must^consist of 

more than one complete clause* if less, then rank "6". 
+ Print can have mature foftais of invented spelling or of 

combinations of other writing units as long as child treats 
individual units as stable. 



^ ^ %r ■ — 1 ■ 

Stable in reference to i^-reading stories means that no clause-level 
units, have been added, omitted, or placed out of composed, sequence. 



19 



Otto & Sulzby 18 



Table\ 2 

Emergent Reading Ability Judgments (ERAJ) for Dictated 
and Handwritten Stories of Children of Differing Abilities 
Across Composition Mode and Trials 



Source 


SS 

t 


df 


ms 


F 




Total 


151.31 


53 








Between 


102.48 


8 






* 


Groupg (G) • 


76.92 , 


2 


38.46 


9.03 


<.025 


Errors 


25.56 


6 


4.26 






Within 


51.83 


•45 ' 








Mode (M) 


8.16 


1 


8.1/T 


4.61 


NS 


Trials (T) 


6.03 


2 


3.0F 


' 1.45 


NS 


G x M x 


2.12 


$ 


1.06 




NS 


G x T 


4.19 - 




2.10 


1,01 


NS 


M x T 


6.79 


4 


1.70 


5.31 


<.01 


G x M x T 


2.77 


4 


.69 


2.16 


NS 


Error^ 


3.55 


2 


1.77 






Error2 


8.11 


4 


2.08 






Error 


10.11 < 


32 


;32 







} * 
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Able 



Tkble 3 / 

'Mean Emergent Reading Ability Judgments for 
Dictated and Handwritten Stories: 
Groups by Trials \ 



Groups 



Trial 1. 



Trial 2 



Trial 3 



High- 

Middle 

Low 



c 



6 - 



*5 - 



J* 



CO 

ey 
u 
o 
u 

CO 



►-5 

2S"-' 3 
w 



4 " 



2 " 



1 - 



0 



0' 



6.3 
3.8 
2.8 



6.2 
4.2 
3.2 



jj "* Figure 1 
Mean Emergent Reading Ability Judgments for 

Dictated and Handwritten Stpries: 
* Mode by Trial^ 
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